Trace Formulae, Zeta Functions, Congruences and 
Reidemeister Torsion in Nielsen Theory 

Alexander Fel'shtyn* Richard Hill 



Abstract 

In this paper we prove trace formulae for the Reidemeister number of a 
group endomorphism. This result implies the rationality of the Reidemeister 
zeta function in the following cases: the group is a direct product of a finite 
group and a finitely generated Abelian group; the group is finitely generated, 
nilpotent and torsion free. We connect the Reidemeister zeta function of an 
endomorphism of a direct product of a finite group and a finitely generated 
free Abelian group with the Lefschetz zeta function of the induced map on 
the unitary dual of the group. As a consequence we obtain a relation between 
a special value of the Reidemeister zeta function and a certain Reidemeister 
torsion. We also prove congruences for Reidemeister numbers of iterates of an 
endomorphism of a direct product of a finite group and a finitely generated 
free Abelian group which are the same as those found by Dold for Lefschetz 
numbers. 
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Introduction 

We assume everywhere A to be a connected, compact polyhedron and / : X — > X to 
be a continuous map. Taking a dynamical point of view, we shall be interested in the 
iterates of /. In the theory of discrete dynamical systems the following zeta functions 
have been studied: the Artin-Mazur zeta function 

C f (z) :=exp(£^s»), 



where F(f n ) is the number of isolated fixed points of f n ; the Ruelle zeta function [28 



oo n n— 1 



C f 9 (z) := exp £ - £ II *(/*(*)) > 



11=1 xgFix(f°) k=0 



*Part of this work was conducted during authors' stay in Sonderforschungsbereich 170 "Geometrie 
und Analysis" , Mathematisches Institut der Georg August Universitat zu Gottingen. 



1 



where g : X — > W is a weight function (if g is identically 1 then this is simply the 
Artin-Mazur function); the Lefschetz zeta function 



L /( ,) :=ox P ( 



dimX 



where 

fc=0 

are the Lefschetz numbers of the iterates of /; reduced modulo 2 Artin-Mazur and 
Lefschetz zeta functions twisted Artin-Mazur and Lefschetz zeta functions \ TE \, 



which have coefficients in the group ring ZZH of an Abelian group H. 

The above zeta functions are analogous to the Hasse-Weil zeta function of an alge- 
braic variety over a finite field [|S0[| . Like the Hasse-Weil zeta function, the Lefschetz 
function is always a rational function of z, and is given by the formula: 

dimX 

L f {z) = J] det(/-/, fc .^) ( - 1)fe+1 . 

fc=0 

This immediately follows from the trace formula for the Lefschetz numbers of the 
iterates of /. The Artin-Mazur zeta function has a positive radius of convergence 
for a dense set in the space of smooth self- maps of a compact smooth manifold [|J. 
Manning proved the rationality of the Artin-Mazur zeta function for diffeomorphisms 



of a compact smooth manifold satisfying Smale's Axiom A [p3|l . The value of knowing 
that a zeta function is rational is that it shows that the infinite sequence of coefficients 
is closely interconnected, and is given by the finite set of zeros and poles of zeta 
function. 

The Artin-Mazur zeta function and its modifications count periodic points of a map 
geometrically, and the Lefschetz's type zeta functions do the same thing algebraically 
(with weight defined by index theory). A third way of counting periodic points is to 
use Nielsen theory. Let p : X — > X be the universal covering of X and / : X — > X a 
lifting of /, ie. p o f — f o p. Two liftings / and /' are said to be conjugate if there is 
a 7 G T = 7Ti(X) such that /' = 7 o / o •y~ 1 . The subset p(Fix(f)) C Fix(f) is called 
the fixed point class of f determined by the lifting class [/]. A fixed point class is said 
to be essential if its index is non-zero. 

The number of lifting classes of / (and hence the number of fixed point classes, 
empty or not) is called the Reidemeister number of /, denoted R(f). This is a positive 
integer or infinity. The number of essential fixed point classes is called the Nielsen 
number of /, denoted by N(f). The Nielsen number is always finite. Both Nielsen 
and Reidemeister numbers are homotopy type invariants. In the category of compact, 
connected polyhedra the Nielsen number of a map is a lower bound for the least 
number of fixed points of maps in the homotopy class of /. 

Let G be a group and <fi : G — ► G an endomorphism. Two elements a, a' G G are 
said to be 4> — conjugate if there exists 7 G G such that a' = 7-a-0(7) _1 . The number 
of 0-conjugacy classes is called the Reidemeister number of 0, denoted by R{4>)- We 
shall also write TZ(4>) for the set of 0-conjugacy classes of elements of G. One easily 
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shows that if ip is an inner automorphism of G then R(<f)oifj) = Ri^jjo cf) = R(<f>). The 
group-theoretical and topological Reidemeister numbers are related as follows. If G 
is the fundamental group of X and <fi is the endomorphism of G induced by / (this is 
only defined modulo inner automorphisms) then R(4>) = R(f)- 

If we consider the iterates of / and 0, we may define several zeta functions associ- 
ated with Nielsen fixed point theory (see We assume throughout this article 
that R(f n ) < oo and R(<p n ) < oo for all n > 0. The Reidemeister zeta functions of / 
and (f) and the Nielsen zeta function of / are defined as power series: 



R^{z) := exp ^ 



-z 



n=l U 



OO T)( £n\ 



R f (z) := ex P (£ J ' (/ 



-z 



n=l 12 



N f (z) := exp £ 



z 



n=l n 



These functions are homotopy invariants. The Nielsen zeta function Nf(z) has a 
positive radius of convergence which has a sharp estimate in terms of the topological 
entropy of the map / fl3fl . In section 2 we give another proof of positivity of the 



radius of convergence. We also obtain an exact algebraic lower bound for the radius 
using the Reidemeister trace formula for generalized Lefschetz numbers. 

We begin the article by proving in section 1 trace formulae for Reidemeister num- 
bers in the following cases: G is finite; G is a direct product of a finite group and a 
finitely generated free Abelian group; G is a finitely generated torsion free nilpotent 
group. By this we mean that there are finite dimensional complex vector spaces H l for 
i — 0, . . . N and linear maps Tj : H l —>■ H % such that for every natural number n, the 
Reidemeister number of <p n is equal to J2iLo(~ l) n Tr (TJ 1 ). Thus the definition of the 
Lefschetz number is a trace formula. These results had previously been known only 
for the finitely generated free Abelian groups |J, although the case of finite groups is 
implicit in 0, 

The trace formula for the Reidemeister numbers implies the rationality of the 
Reidemeister zeta function. In section 2 we also prove functional equations for the 
Reidemeister zeta function of group endomorphisms in the above cases. 

In section 2 we also study analytic properties of the Nielsen zeta function. We 
give a new proof of the positivity of the radius of convergence of Nf(z), and give an 
exact algebraic lower bound for the radius. The radius of convergence of Nf(z) is 
directly related to the asymptotic Nielsen number, which is defined to be the growth 
rate of the sequence N(f n ) of the Nielsen numbers of the iterates of /. It is worth 
mentioning that in all known cases the Nielsen zeta function is a nice function. By 
this we mean that it is a product of an exponential of a polynomial with a function 
some power of which is rational. 

In section 1 we prove arithmetical congruences : 

H(d) ■ R{<p n/d ) = mod n, 

d\n 
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for the Reidemeister numbers of the iterations of a group endomorphism of a direct 
product of a finite group and a finitely generated free Abelian group and corresponding 
congruences 

£>(d) -R{f n/d ) =0modn 

d\n 

for the Reidemeister numbers of a continuous map /. These congruences are the same 
as those found by Dold []5| for Lefschetz numbers. 

Recently a connection between the Lefschetz type dynamical zeta functions and 
the Reidemeister torsion was established by D. Fried |16|, [17|. The work of Milnor 
Ml was the first indication that such a connection exists. In section 3 we establish 



a connection between Reidemeister torsion and the Reidemeister zeta function. We 
obtain an expression for the Reidemeister torsion of the mapping torus of the dual 
map of an endomorphism of a direct product of a finite group and a finitely generated 
free Abelian group, in terms of a special value of the Reidemeister zeta function of the 
endomorphism. The result is obtained by expressing the Reidemeister zeta function in 
terms of the Lefschetz zeta function of the dual map, and then applying the theorem of 
D. Fried. This means that the Reidemeister torsion counts the periodic point classes 
of the map /. These results had previously been known for the finitely generated 
Abelian groups and finite groups fTT[ . 

We would like to thank J. Eichhorn , D. Fried, M. L. Gromov and B. B. Venkov 
for valuable conversations and comments. We would like to thank Institut des Hautes 
Etudes Scientifiques in Bures-sur-Yvette and the Max Planck Institut fiir Mathematik 
in Bonn for their kind hospitality and support. 



1 Group Theoretical Reidemeister Numbers 

Let be an endomorphism of a group G. We shall write the group law of G multiplica- 
tively. We shall write {<?}</, for the 0-conjugacy class of an element g G G. We shall 
write < g > for the ordinary conjugacy class of g in G. The endomorphism maps 
conjugate elements to conjugate elements. It therefore induces an endomorphism of 
the set of conjugacy classes in G. 

Theorem 1 ( [|1 1|| ) Let G be a finite group and let : G — > G be an endomorphism. 
Then R(4>) is the number of ordinary conjugacy classes < x > in G such that 

< <p(x) >=< x > . 

We now rephrase this to give a trace formula. Suppose G is finite and let W be 
the vector space of complex valued class functions on the group G. A class function 
is a function which takes the same value on every element of a usual conjugacy class. 
The map induces a linear map B : W —> W defined by 

B{f) :=/o0. 

We shall write G for the set of isomorphism classes of irreducible unitary repre- 
sentations of G. There is a multivalued map : G — > G defined as follows. Let 
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p : G — > U(V) be an irreducible unitary representation. Then we obtain a repre- 
sentation (f>*p of £? on V by 4>*p(g) = p(4>(g)). The representation 0*p is a sum of 
irreducible pieces; we define 0(p) to be this set of pieces. If is bijective or G is 
Abelian then is single valued. 

Theorem 2 Let cf) : G ^ G be an endomorphism of a finite group G. Then we have 

R((f)) = #Fix(0) = Tr B (1) 

In the case when is the identity map, this is Burnside's result equating the 
number of irreducible representation of a finite group with the number of conjugacy 
classes in the group. 

Proof. We shall calculate the trace of B in two ways. The characteristic functions 
of the conjugacy classes in G form a basis of W, and are mapped to one another by B 
(the map need not be a bijection). Therefore the trace of B is the number of elements 
of this basis which are fixed by B. By Theorem 1, this is equal to the Reidemeister 
number of 0. Another basis of W, which is also mapped to itself by B is the set of 
traces of irreducible representations of G (see |TI| chapter XVIII). From this it follows 



that the trace of B is the number of irreducible representations p of G such that p has 
the same trace as 0(p). However, representations of finite groups are characterized 
up to equivalence by their traces. Therefore the trace of B is equal to the number of 
fixed points of 0. □ 

The following result is known for free Abelian groups: 
Theorem 3 ( [|1 1|| ) Let : ZZ k — > Z k be a group endomorphism. Then 

J R(0) = |det(/-0)| = #Fix(0). 
Furthermore the following trace formula holds: 

k 

W) = (-l) r+P E(-l) 4 Tr (A>). (2) 

where p the number of eigenvalues pi of M such that p, < —1, and r the number of 
real eigenvalues whose absolute value is > 1. Here A* denotes the exterior power. 

Now let F be a finite group and k a natural number. We shall consider an en- 
domorphism of the group G = ZZ k x F. Our aim is to prove a trace formula for 
the Reidemeister number of such an endomorphism. The torsion elements of G are 
precisely the elements of the finite, normal subgroup F. For this reason we have 
0(F) C F. Let <p finite : F —> Fbe the restriction of to F, and let 0°° : G/F -> G/F 
be the induced map on the quotient group. Let pr % k : G — > Z k and pr F : G — > F 
denote the projections onto 2L k and F. Then the composition 

pr % k o : % k -> G -> % k 
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is an endomorphism of ^ fc , which is given by some matrix M G M.^{2Z). We denote 
by ip : Zj k — > F the other component of the restriction of <fi to Z k , i.e. 

^(u) = pr F ((f)(v)). 

We therefore have for any element (v, f) G G 

<j>(v,f) = (M-v,1>(v)<j>(f)). 

Lemma 1 Let G be as above. Two elements g 1 = (vi, /i) and g 2 = (v 2 , f 2 ) of G. are 
(p-conjugate if and only if 

Vi = v 2 mod (1 - M)% k 

and there is a h G F with 

hh = f 2 <t>{{l-M)- 1 {v 2 -v l ))(t>{h). 

Proof. Suppose g\ and g 2 are 0-conjugate. Then there is a g 3 = (w, h) G G with 
939i = gA{g$)- Therefore 

(w + v u hfi) = (v 2 + M-w, f 2 ^(w)(j)(h)). 

Comparing the first components we obtain (1 — M) ■ w — v 2 — V\ from which it follows 
that v\ is congruent to v 2 modulo (1 — M)/Z r . Substituting (1 — M)~ 1 (v 2 — v\) for w 
in the second component we obtain the second relation in the lemma. The argument 
can easily be reversed to give the converse. □ 

Proposition 1 In the notation described above, R(4>) = R{$ %mie ) x R(4>°°). 

Proof. We partition the set TZ((p) of 0-conjugacy classes of elements of G into 
smaller sets: 

H(4>) = ^ veZ k /{1 _ M)Z kTZ(v), 

where TZ(v) is the set of 0-conjugacy classes {(w, /)},/, for which w is congruent to v 
modulo (1 — M)/Z k . It follows from the previous lemma that this is a partition. Now 
suppose {(w, f)}<t, G lZ(v). We will show that {(w, f)}^ = {(v, f *)}</> for some /* G F. 
This follows by setting /* = fip((l — M)~ l (w — v)) and applying the previous lemma 
with h = id. Therefore TZ(v) is the set of 0-conjugacy classes {(v , f)}^ with / G F. 
From the previous lemma it follows that (v, f\) and (v, f 2 ) are 0-conjugate iff there is 
a h G F with 

hfi = hmm = f2m 

This just means that f\ and f 2 are 0^ mite -conjugate as elements of F. From this it 
follows that TZ(v) has cardinality R((p^ mte ) . Since this is independent of v, we have 

R((j)) = Y J R{<P fmtte ) =| det(l - M) | xR(<p finite ). 
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Now consider the map 0°° : G/F — ► G/F. We have 

(f>°°((v, F)) = (M ■ v, ip(v)F) = (M ■ v, F). 

From this it follows that 0°° is equivalent to the map M : Z k — > /Z k . This implies 

#(0°°) = R(M : Z k -> Z k ). 

However by Theorem ^ we have R(M : % k — > Z k ) =\ det(l — M) |. Therefore 
R(4>) = _R(0-^ mte ) x R(4>°°), proving Proposition 1. □ 

Proposition 2 In the notation described above 

#Fix (0) = #Fix (0^ ite ) x #Fix (0°°) 
Proof. Consider the dual G. This is cartesian product of the duals of 2L k and F: 

G = % k x F, p = Pl ® p 2 

where p\ is an irreducible representation of 2L k and P2 is an irreducible representation 
of F . Since /Z r is Abelian, all of its irreducible representations are 1-dimensional, 
so p(v) for v G /Z k is always a scalar matrix, and P2 is the restriction of p to F. If 
0(p) = p then there is a matrix T such that 

p o = T ■ p ■ T^ 1 . 

This implies 

finite Q ^finite _ rp _ finite _ y-1 

so p2 = pf m%te is fixed by 0/ mite . For any fixed p 2 G <S(0^ m<e ), the set of pi such that 
Pi <8> P2 is fixed by is the set of pi satisfying 

p 1 (M-i;)p 2 (^(i;))=T-p 1 (i;)-T- 1 

for some matrix T independent of v G /% k . Since pi(v) is a scalar matrix, the equation 
is equivalent to 

Pl {M-v)p 2 {i;{v))=p 1 {v), 

i.e. 

Pl ((l-M)v) = p 2 (iP(v)). 

Note that Z k is isomorphic to the torus T k , and the transformation Pi — > p x o (1 — M) 
is given by the action of the matrix 1 — M on the torus T fc . Therefore the number 
of pi satisfying the last equation is the degree of the map (1 — M) on the torus, i.e. 
| det(l — M) |. From this it follows that 

#Fix (0) = #Fix (0 /mite )x | det(l - M) | . 

As in the proof of Proposition 1 we have i?(0°°) =| det(l — M) |. Since 0°° is an 
endomorphism of an Abelian group we have #Fix (0°°) = R(<f>°°). Therefore 

#Fix (0) = #Fix (0^ lte ) x #Fix (0°°). 

□ 

As a consequence we have the following: 
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Theorem 4 If (f) be any endomorphism of G where G is the direct product of a finite 
group F with a finitely generated free Abelian group, then 



R{(j>) = #Fix (0) 

Proof. Since 0/* mte is an endomorphism of a finite group, by Theorem 2 we have 
R(cj)f mite ) = #Fix (0-^ mte ). Since 0°° is an endomorphism of the finitely generated 
free Abelian group we have R(4>°°) = #Fix (0°°) (see Theorem 2 in [lit]). It follows 
from Propositions 1 and 2 that R(4>) = #Fix (0). □ 

Let W be the vector space of complex valued class functions on F. The map 
induces a linear map B : W — *> W defined as above in Theorem ^. 

Theorem 5 If G is the direct product of a free Abelian and a finite group and an 
endomorphism of G. Then the following trace formula holds: 

#(0) = (-l) r +Pj2(-iyTr (A>°° ® 5), (3) 

i=0 

where k is the rank of the free Abelian group G/F; p is the number of /i £ Spec 0°° 
siic/i i/iai /i < —1, and r i/ie number of real eigenvalues of 0°° whose absolute value 
is > 1. 

Proof. This follows from Theorems |3] and Proposition [l] and the formula 

Tr (A^ 00 ) • Tr (B) = Tr (A^ 00 ® B). 

□ 

Finally let T be a finitely generated, torsion free, nilpotent group. It is known 
[22]j that any such group is a uniform, discrete subgroup of some simply connected 



nilpotent Lie group G (uniform means that the coset space G/Y is compact). The 
space M = G/Y is called a nil-manifold. Since Y = TTi(M) and M is a i^(r, 1), every 
endomorphism : T — > T may be realized by a self-map / : M — > M such that /* = 
and thus = R(<f>)- Any endomorphism : T — > T may be uniquely extended 

to an endomorphism F : G — > G. Let F : G — >• G be the corresponding Lie algebra 
endomorphism induced from F. 

Theorem 6 If <fi an endomorphism of a finitely generated torsion free nilpotent group 
Y then 

m 

R{4>) = (-ly+^-iflr A* F, (4) 

i=0 

where m is Rank Y = dimM; p is the number of eigenvalues \x of F such that [l < — 1, 
and r the number of real eigenvalues of F whose absolute value is > 1. 
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Proof. Let / : M — > M be a map realizing on a compact nil-manifold M of 
dimension m. We are assuming throughout this article that the Reidemeister number 
R{f) = R{4>) is finite. The finiteness of R(f) implies the non- vanishing of the Lefschetz 
number L(f) A strengthened version of Anosov's Theorem ffl is proven in pp| 
which states in particular, that if L(f) 7^ then N(f) = \L(f)\ = R(f). However it 
is known that L(f) = det(F — 1) [p]]. From this we have 

R{t/>) = R(f) = \L(f)\ = | det(l - F)| = (-l)^det(l - F) 

m 

= (-l) r+p ^(-l) 4 Tr A* F. 

□ 



Theorem 7 f[T^J) Let T be a finitely generated torsion free nilpotent group of rank 
k. For any endomorphism <p : T — > T such that R(<f)) is finite, there exists an endo- 
morphism ip : Z k -> Z k such that for all n G IN, R((j) n ) = #Fix 4> n . 

The following lemma is also useful for calculating Reidemeister numbers; it often 
allows one to reduce to the case that is an isomorphism. 

Lemma 2 Let <p : G —>■ G be any endomorphism of any group G, and let H be a 
subgroup of G with the properties 

<j){H) C H 
\/x G G 3n G N such that (p n (x) G H. 

Then 

R{4>) = R(<j> H ), 
where 4>h '■ H — > H is the restriction of <p to H . 

Proof . Let x £ G. Then there is an n such that <p n (x) G H. It is known that x 
is (^-conjugate to <ft n (x)(see for example JT9" |. This means that the 0-conjugacy class 
{x}^ of x has non-empty intersection with H. 

Now suppose that x,y G H are 0-conjugate, ie. there is a g G G such that 

gx = y<f>{g). 

We shall show that x and y are 0^-conjugate, ie. we can find a g G H with the above 
property. First let n be large enough that <f) n {g) G H. Then applying n to the above 
equation we obtain 

<P n (gW(x) = ^{yW+^g). 

This shows that <p n (x) and <f) n (y) are 0^-conjugate. On the other hand, one knows 
that x and 4> n (x) are ^-conjugate, and y and 4> n (y) are 4>h conjugate, so x and y 
must be 0#-conjugate. 
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We have shown that the intersection with if of a 0-conjugacy class in G is a 
(/>#-conjugacy class in H . We therefore have a map 

Rest : K{<t>) -> 7e(0 H ) 
>-> {x} 4 ,nH 

This clearly has the two-sided inverse 

{ X }<j>H ^ 

Therefore Rest is a bijection and R(4>) = R(4>h)- d 

Corollary 1 Lei # = ri (G). Then R{<f>) = R{<j> H ). 

As an application of this we prove congruences for Reidemeister numbers. Let 
n(d), d E IN be the Mobius function, i.e. 

'1 if d = 1, 

M^) = ^ ( — if ^ is a product of distinct primes, 
if d is not square-free. 

Theorem 8 Let <p : G — > G &e an endomorphism of the group G such that all numbers 
R((f) n ) are finite, and let H be a subgroup of G with the properties 

4>{H) C H 

\/x eG3ne IN such that <f) n (x) e H. 

If one of the following conditions is satisfied: 

(I) H is a direct product of a finite group and a finitely generated free Abelian group, 
or 

(II) H is finitely generated, nilpotent and torsion free , then one has for all natural 
numbers n, 

£>(d) ■R(<p n/d ) ^Ornod n. 

d\n 

Proof. From Theorem 4 and Lemma 2 it follows immediately that, in case I, for 
every n 

R((f) n ) = #Fix [<f H n :H^H. 

Let P n denote the number of periodic points of 4>h of least period n. One sees 
immediately that 

J R(0") = #Fix [<f H n ] =Y,Pd- 

d\n 

Applying Mobius' inversion formula, we have, 

p n = j2Kd)R(r /d )- 

d\n 

On the other hand, we know that P n is always divisible be n, because P n is exactly 
n times the number of 0^-orbits in H of length n. In the case II when H is finitely 
generated, nilpotent and torsion free, we know from Theorem 7 that there exists an 
endomorphism if) : Z n — > Z™ such that R(<f) n ) = #Fix ip n . The proof then follows as 
in previous case. □ 
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2 Reidemeister and Nielsen zeta functions 

In this section we reinterpret the results of the previous section in terms of the Rei- 
demeister zeta function. We show in the cases that we have considered that the zeta 
function is a rational function with a functional equation. 

Theorem 9 Let G be the direct product of a free Abelian and a finite group and an 
endomorphism of G. Then R^z) is a rational function and is equal to 

I k \ Mr 

M z ) = (JI det (! " A >°° ®B-a- z)^ +1 J (5) 

where matrix B is as defined in Theorem 2, a = (— l) p , p , r and k are the constants 
described in Theorem 3. 

Proof. From Proposition 1 it follows that R((f) n ) = R((<p°°) n ■ R(((f) finite ) n ) . From 
this formula, Theorem 2 and 3 we have the trace formula for R((f) n ): 

k 

R^) = (— l) r+pn ^(— l)*Tr A* (0°°)™ ■ Tr B n 

i=0 
k 

= (-l) r +P n ]T(-l) l Tr (A^ 00 )™ <g> B n ) 

i=0 
k 

= {-\y+P n ^(-l)*Tr (A>°° <g> B) n . 

i=0 

We now calculate directly 

= ex P '^'ra.i-'i^iAy^)-,,.,),) 

\n=l 71 J 

k / / oo -i \ \ (-i)^ ( - _1 ' )r 

n (^p (e - Tr ( a >°° ® • (o- • *rj j 



("[] det (l - A>°° (g) 5 • a • z) ( 

\i=0 / 



-i) r 



□ 



Theorem 10 If T is a finitely generated torsion free nilpotent group and <fi an endo- 
morphism ofY .Then R^(z) is a rational function and is equal to 

(m \ (- 1 ) r 

IIdet(l- A l F-a-z)^ +1 j (6) 

where a = (—l) p ,p , r , m and F is defined in theorem 6 
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Proof. If we repeat the proof of the Theorem 4 for <p n instead <p we obtain that 
R(<f) n ) = (— iy+P n det(l — F)( we suppose that Reidemeister numbers R(<f) n ) are finite 
for all n).Last formula implies the trace formula for R(<f) n ): 

m 

R((f) n ) = (-l) r +P n ^(-l)*Tr (A i F) n 

i=0 

From this we have formula 6 immediately by direct calculation as in Theorem 9. □ 

Corollary 2 Under the assumptions of Theorem 6, the zeros and poles of the Reide- 
meister zeta function are reciprocals of eigenvalues of one of the maps 

A l F : A*G — > A i G < i < Rank Y 

We now turn our attention to the functional equations satisfied by these zeta 
functions. These equations are consequences of a duality on the vector spaces with 
which we have obtained trace formulae. 

Theorem 11 Let V be a finitely generated, torsion free, nilpotent group and <fi an 
endomorphism of Y . The Reidemeister zeta function R^z) satisfies the following 
functional equation: 

R,(l)=e 1 -R,(z)^ kr , (7) 
where d = det F and e\ is a non-zero complex constant. 

Proof. Via the natural non-singular pairing (A l F) £g> (A m ~ t F) — > W the operators 
A m ~ l F and d ■ (A t F)~ 1 are adjoint to each other. 

Consider an eigenvalue A of A' l F. By Theorem 10, This contributes a term 



/ J„\ M)^ ( " 1)r 



to (^)- This may be rewritten as follows 

f —dz 

Note that | is an eigenvalue of A m ~ l F. Multiplying these terms together we obtain, 

*(s) = (n o n ^VT xRM "" 

AWgSpec /\ l F J 

The variable z has disappeared because 

m m 

£(-1)* dim A l G = ^(-1)^- = 0. 

i=0 i=0 

□ 



12 



2.1 The Reidemeister zeta functions of a continuous map. 

Now suppose X is a compact, connected polyhedron with universal cover X and let 
/ : X — > X is a continuous self-map. We choose a lifting / : X — > X of / as reference. 
Let T be the group of covering translations of X over X. Then every lifting of / can 
be written uniquely as 7 o /, with 7 G T. So elements of T serve as coordinates of 
liftings with respect to the reference /. Now for every 7 G T the composition / o 7 is 
a lifting of / so there is a unique 7' G T such that 7' o / = / o 7. This correspondence 
7 1— ► 7' is an endomorphism of T. As such it is dependent on the choice of /. However 
the class of the endomorphism modulo inner endomorphisms of T depends only on 
the map /. 

Definition 1 The endomorphism /# : T —>■ V determined by the lifting f of f is 
defined by 

/*(7) / = / °7- 



Lemma 3 \TyjJ Lifting classes of f are in one to one correspondence with f^-conjugacy 
classes in tt, the lifting class [7 o /] corresponding to the f*-conjugacy class 0/7. We 
therefore have R(f) = R(f*)- 

Using this lemma we may apply all previous theorems to the Reidemeister zeta 
functions of continuous maps. 

2.2 Convergence of the Nielsen Zeta Function 

We denote by R the radius of convergence of the Nielsen zeta function Nf(z), and by 
h(f) the topological entropy of a continuous map /. Let h be the infimum of h(g) 
where g ranges over maps with the same homotopy type as /. The following is known. 

Theorem 12 ( ||13|| ) With the above notation R > exp(-h) > 0. 

The radius of convergence R is directly connected with asymptotic Nielsen number 
which is defined to be the growth rate of the sequence {N(f n )} of the Nielsen numbers 
of the iterates of /. In this section we give a new proof that R is positive, and give 
an exact algebraic lower bound for R using the trace formulae (13) and (14) for 
generalized Lefschetz numbers. 



We begin by recalling some known facts (see Pq|,P^|,[|5||,pQ|). The fundamental 
group tt = 7Ti(X, x ) splits into /*-conjugacy classes. Let 717- denote the set of /*- 
conjugacy classes, and ZZiif denote the Abelian group freely generated by 717. We 
shall use the bracket notation a 1— > [a] for both projections tt — ► 717 and /Ztt — > Zir/. 
Let x be a fixed point of /. Choose a path c from xo to x. The /^-conjugacy class in 
tt of the loop c • (/ o c) -1 , which is evidently independent of the choice of c, is called 
the coordinate of x. Two fixed points are in the same fixed point class F iff they 
have the same coordinates. This /^-conjugacy class is thus called the coordinate of 
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the fixed point class F and denoted cd n (F, f). The generalized Lefschetz number or 
the Reidemeister trace [EB1 is defined as 



L v (f) := £ Index (F, f) ■ cd n (F, f) G Z* s , (8) 

the summation being over all essential fixed point classes F of /. The Nielsen number 
iV(/) is the number of non-zero terms in L^-(/), and the indices of the essential fixed 
point classes appear as the coefficients in L n (f). This invariant used to be called 
the Reidemeister trace because it can be computed as an alternating sum of traces 
on the chain level as follows (p6|,[pS(]). Assume that X is a finite cell complex and 
/ : X — > X is a cellular map. 

A cellular decomposition {e^} of X lifts to a 7r-invariant cellular structure on the 
universal covering X. Choose an arbitrary lift ej for each e^. These lifts constitute 
a free ^7r-basis for the cellular chain complex of X. The lift / of / is also a cellular 
map. In every dimension d, the cellular chain map / gives rise to a ^7r-matrix Fj 
with respect to the above basis, i.e. F d = (a^) if fief) = J2j a ij^, where G Zn. 
Then we have the Reidemeister trace formula 

LAf) = Et- 1 )'^ Fd] G ZvTf. (9) 

d 

We now describe alternative approach to the Reidemeister trace formula proposed 
by Jiang P0fl . This approach is useful when we study the periodic points of /. The 
mapping torus Tf of / : X — > X is the space obtained from X x [0, oo) by identifying 
(x, s + 1) with (/(#), s) for all x G X, s G [0, oo). On Tf there is a natural semi-flow 
<f) : Tf x [0, oo) — » T/, 0t(o;, s) = (sc, s + t) for all t > 0. The function / : X — > X is 
the return map of the semi-flow <fi. A point x G X and a positive number r determine 
the orbit curve <t>i x>T ) '■= 0t( a; )o<i<T ^ n ^7- Take the base point Xq of X as the base 
point of Tf. It is known that the fundamental group H := 7ti(Tf,xo) is obtained 
from 7r by adding a new generator z and adding the relations z~ x gz = f*(g) for all 
g G 7r = tti(X, xq). Let if c denote the set of conjugacy classes in H and let MH be 
the integral group ring of H . Define also fflH c to be the free Abelian group with basis 
H c . We again use the bracket notation a — > [a] for both projections H ^ H c and 
— > /EH C . If F n is a fixed point class of / n , then f(F n ) is also fixed point class 
of f n and Index (f(F n ),f n ) = Index (F n ,f n ). Thus / acts as an index-preserving 
permutation among fixed point classes of f n . We define an n-orbit class O n of / 
to be the union of elements of an orbit of this action. In other words, two points 
x, x 1 G Fix(f n ) are said to be in the same n-orbit class of / if and only if some f l (x) 
and some f^(x') are in the same fixed point class of f n . The set Fix(f n ) is a disjoint 
union of n-orbit classes. A point x is a fixed point of f n if and only if <p(x,n) is a 
closed curve. The free homotopy class of the closed curve <f>(x,n) wiU b e called the 
incoordinate of point x, written cdn(x, n) = [4>( x ,n)} £ H c . It follows that periodic 
points x of period n and x' of period n' have the same if-coordinate if and only if 
n = n', and x and x' belong to the same n-orbits class of /. 
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Recently, Jiang |2(J] has considered generalized Lefschetz number with respect to 

H: 

MD ■= E Index f n ) ■ cd H (O n ) e ZH C . (10) 
He proved the following trace formula: 

L H {f n ) = E(-!) d [ Tr ( z Fd)1 G ZH C , (11) 

d 

where are the ^7r-matrices defined in (9) and zF d is regarded as a ^iJ-matrix. 

For any set S let ^5* denote the free Abelian group with basis S. Define a norm 
on by 

HE^ilh=EIM e ^ (12) 

£ i 

where the s, in S are all different. 

For a ZH-mathx A = (a^-), define its norm by \\A\\ := \\°>ij\\- Then we have 
inequalities || AB|| < \\A \ ■ \\B\\ when A, B can be multiplied, and ||Tr A|| < when 
A is a square matrix. For a matrix A = (a^) in ZES, its matrix of norms is defined to 
be the matrix A norm := (||fly||) which is a matrix of non-negative integers. In what 
follows, the set S will be ir, H or H c . We denote by s(A) the spectral radius of A, 
s(A) = lim n (||74 n || |)~, which coincides with the largest modulus of an eigenvalue of 
A. 

Theorem 13 For any continuous map f of any compact polyhedron X into itself the 
Nielsen zeta function has positive radius of convergence R, which admits following 
estimations 

R > > (13) 

max d \\zF d \\ 



and 



where Fa is as in (9). 



R > L > 0, (14) 



maxrf s(F c 



Proof. By the homotopy type invariance of the invariants we can suppose that / 
is a cellular map of a finite cell complex. By definition the Nielsen number N(f n ) is 
the number of non-zero terms in L 7T (f n ). The norm ||L#(/ ri )|| is the sum of absolute 
values of the indices of all the n-orbits classes O n . It equals ||L 7r (/ ri )||, the sum of 
absolute values of the indices of all the fixed point classes of f n , because any two 
fixed point classes of f n contained in the same n-orbit class O n must have the same 
index. From this we have N(f n ) < ||^(/ n )|| = \\L H (f n )\\ = || Ed(-l) d [Tr (zF d ) n }\\ < 
£dl|[Tr(^)"]|| < EdllTr (zF d ) n \\ < Ed\\(zF d ) n \\ < E d \\(zF d )\\ n (see Q). The 
radius of convergence R is given by the Cauchy-Hadamard formula: 

4 = limsup(^S)^ = limsup(AT(/ n ))i 

R n n n 
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Therefore we have: 

1 1 
R = - > =— > 0. 

limsup n (A^(/ n ))n max d ||zFj 

The inequalities: 

NT) < IMr)IHIMr)IHI£(-i)lTr (^)1II< Ellt^ 
< ll Tr (^) n ll < E Tr ((^)T orm < E Tr ((^r°"T 



<ETr ((F d 



.norm\n 



d 



together with the definition of spectral radius give the bound: 

1 1 

R = r > > 0. 

limsup n (iV(/ n ))» max d s(F2 orm ) 



□ 



Example 1 Let X be a surface with boundary, and f : X — > X a continuous map. 
Fadell and Husseini ^ devised a method of computing the matrices of the lifted chain 
map for surface maps. Suppose {ai, . . . ,a r } is a free basis for ni(X). Then X has 
the homotopy type of a bouquet B of r circles which can be decomposed into one 0-cell 
and r 1- cells corresponding to the a,, and f has the homotopy type of a cellular map 
g : B — > B. By the homotopy invariance, we may replace f by g in computations. 
The homomorphism /* : 7Ti(X) — > 7Ti(X) induced by f or g is determined by the 
images = i = 1, . . . ,r. The fundamental group i^xiTf) has a presentation 

7Ti(7/) =< oi, a r , z\aiZ — zbi, i — 1, .., r >. Let 

be the Jacobian in Fox calculus (see W). Then, as pointed out in j^, the matrices of 
the lifted chain map g are 

« = * = D = & 

Now, we may find bounds for the radius R using the above theorem. 



3 Reidemeister Torsion as a Special Value 

Reidemeister torsion is an algebraically defined quantity associated to an acyclic 
cochain complex. It is used to distinguish between complexes with the same homology. 
Roughly speaking, if Euler characteristic is regarded as a graded version generaliza- 
tion of dimension, then Reidemeister torsion may be viewed as a graded version of the 
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absolute value of the determinant. More precisely, let d % : C l — > C l+1 be a bounded, 
acyclic cochain complex of finite dimensional complex vector spaces. There is a chain 
contraction 5 l : C l — > C 1 ^ 1 ie. a linear map such that doS + 5od = id. We have 
linear maps (d + 5)+ : C+ := ©C 2i -»• C~ := ©C 2i+1 and (d + 5)_ : C~ -> C+. Since 
(d+5) 2 = ic?+5 2 is unipotent, it follows that (d+5) + is bijective. Given positive densi- 
ties Aj on C\ we may define with respect to these densities, t(C*, Aj) :=| det(d+5) + \ 
(see 0). 

Reidemeister torsion is used in the following geometric setting. Let K is a finite 
simplicial complex and E a flat, finite dimensional, complex vector bundle over K 
with fibre V. Denote by pe '■ 7Ti(K) — > GL(V) the holonomy of E. Suppose now 
that one has on each fibre of E a positive density which is locally constant on K. 
In terms of pe this assumption means | det pe |= 1. The cochain complex C l (K;E) 
with coefficients in E may be identified with the direct sum of copies of V associated 
to each i-ce\l a of K. This identification is achieved by choosing a base point in each 
component of K and a base point in each i-cell. By choosing a flat density on E we 
obtain a preferred density A, on each C l (K,E). The Reidemeister torsion t(K;E) 
is then defined to be the positive real number t(C*(K; E), Aj). This has many nice 
properties. It is invariant under subdivisions of K. Thus for a smooth manifold, one 
may unambiguously define t(K; E, Di) to be the torsion of any smooth triangulation 
of K. However, Reidemeister torsion is not an invariant under a general homotopy 
equivalence. This was in fact the reason for its introduction. 

In the case that K is the circle S 1 , let A be the holonomy of a generator of its 
fundamental group 7ri(S' 1 ). Then E is acyclic if and only if I — A is invertible and 
then 

t(S 1 ; E) =| det (J - A) \ (15) 

Note that the choice of generator is irrelevant as / — A^ 1 = (— A~ l )(I — A) and 
\det(-A- 1 )\ = l. 

It might be expected that the Reidemeister torsion counts something geometric 
(like the Euler characteristic). D. Fried showed that it counts the periodic orbits of a 
flow and the periodic points of a map. We will show that Reidemeister torsion counts 
the periodic point classes of a map (fixed point classes of the iterations of the map). 

Some further properties of r describe its behavior under bundles. 

Suppose p : X — > B is a simplicial bundle with fiber F, where F, B, X are all 
finite complexes and p~ l lifts subcomplexes of B to subcomplexes of X. We assume 
here that E is a flat, complex vector bundle over B . We form its pullback p*E over 
X. Note that the vector spaces if'(p _1 (6), W) with b G B form a flat vector bundle 
over B, which we denote H l F. The integral lattice in H l (jp^ 1 {b) J 1R) determines a 
flat density by the condition that the covolume of the lattice is 1. Suppose that the 
bundle E ® H l F is acyclic for all i. Under these conditions D. Fried |I7| has shown 
that the bundle p*E is acyclic, and 

r{X;p*E) = *[[t(B', E ® IPF)W . (16) 



Now let / : X — > X be a homeomorphism of a compact polyhedron X, and let 
Tf := (X x l)/(x,0) ~ (f(x), 1) be the mapping torus of /. We shall consider the 
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bundle p : Tf — > S 1 over the circle S 1 . Given a flat, complex vector bundle E with 
finite dimensional fibre over the base S 1 , we form its pullback p*E over Tf. The 
vector spaces H l (p -1 (6) , (J) with b E S 1 also form flat vector bundles over 5 1 , which 
we denote H l F . The integral lattice in if l (p _1 (5), 1R) determines a flat density by the 
condition that the covolume of the lattice is 1. Suppose that the bundle E ® H l F 
is acyclic for all i. Under these conditions, D. Fried jl7| has shown that p*E is also 
acyclic and the following holds: 

T{T f -,p*E) = '[[T{S 1 ;E®H i F)(- r ) i . (17) 

i 

Let g be the preferred generator of the group 7r 1 (S' 1 ) and let A = p(g), where p : 
7i"i (S 1 ) — > GL(V). The holonomy around <? of the bundle ® fPF is then A® f*. 
Since r(£) =| det(J - A) | it follows from (24) that 

r(T /;P *£) = J] I det(J - A ® /*) 1^ . (18) 

i 

Now consider the special case in which E is one-dimensional, so the holonomy A is a 
complex scalar A with absolute value one. In terms of the rational function Lf(z) we 
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r(Tf,p*E) = J] I det(/ - A./*) 1^=1 L,(A) I" 1 (19) 



Theorem 14 Lei (J) : G ^ G be a group automorphism, where G is the direct sum of 
a finite group with a finitely generated Abelian group, then 

r(T f p*E)=\L i (X)\~' = \R,(a\)t i r + \ 

where A is the holonomy of E around S 1 and r and a are the constants described in 
Theorem 3. 

Proof. We know from Theorem 4 that R{<fi n ) is the number of fixed points of the 
map <p n . It remains to show that the number of fixed points of n is equal to the 
absolute value of its Lefschetz number. We assume without loss of generality that 
n = 1. We are assuming throughout that R(<f)) is finite, so the fixed points of form 
a discrete set. We therefore have 

L{4>) = m dex (4>,x). 

xGFix <f> 

Since is a group endomorphism, the trivial representation xq E G is always fixed. 
Let x be any fixed point of <fi. Since G is union of tori Go,...,Gt and is a linear 
map, we can shift any two fixed points onto one another without altering the map 
0. Therefore all fixed points have the same index. It is now sufficient to show that 
Index (0, xq) = ±1. This follows because the map on the torus 

: Gq — > Gq 
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lifts to a linear map of the universal cover, which is an euclidean space. The index 
is then the sign of the determinant of the identity map minus this lifted map. This 
determinant cannot be zero, because 1 — must have finite kernel by our assumption 
that the Reidemeister number of <fi is finite (if det(l — 0) = then the kernel of 1 — <p 
is a positive dimensional subspace of G, and therefore infinite). □ 

4 Concluding remarks and open questions 

For the case of almost nilpotent groups (ie. groups with polynomial growth, in view of 
Gromov's Theorem flBf ) we believe that some power of the Reidemeister zeta function 
is a rational function and that the congruences for the Reidemeister numbers are also 
true. We intend to prove this conjectures by identifying the Reidemeister number on 
the nilpotent part of the group with the number of fixed points in the direct sums of 
the duals of the quotients of successive terms in the central series. We then hope to 
show that the Reidemeister number of the whole endomorphism is a sum of numbers 
of orbits of such fixed points under the action of the finite quotient group (ie the 
quotient of the whole group by the nilpotent part). The situation for groups with 
exponential growth is very different. There one can expect the Reidemeister number 
to be infinite as long as the endomorphism is injective. 
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